Linear-quadratic optimal control under non-Markovian switching

Linear Quadratic Optimal Control Problem of Stochastic Switching Systems

Switched systems have numerous applications in control of real systems as mechanical systems, automotive industry, aircraft and air traffic control, switching power converters, and many other fields. Optimal control problems of switching systems require the decision of both the optimal solutions and switching sequences. The stochastic optimal control problem of linear switching systems with qua...

Optimal Linear Quadratic Control

Linear Quadratic Optimal Control

In previous lectures, we discussed the design of state feedback controllers using using eigenvalue (pole) placement algorithms. For single input systems, given a set of desired eigenvalues, the feedback gain to achieve this is unique (as long as the system is controllable). For multi-input systems, the feedback gain is not unique, so there is additional design freedom. How does one utilize this...

Piecewise linear quadratic optimal control

The use of piecewise quadratic cost functions is extended from stability analysis of piecewise linear systems to performance analysis and optimal control. Lower bounds on the optimal control cost are obtained by semi-definite programming based on the Bellman inequality. This also gives an approximation to the optimal control law. An upper bound to the optimal cost is obtained by another convex ...

Global Optimization for Solving Linear Non-Quadratic Optimal Control Problems

This paper presents a global optimization approach to solving linear non-quadratic optimal control problems. The main work is to construct a differential flow for finding a global minimizer of the Hamiltonian function over a Euclid space. With the Pontryagin principle, the optimal control is characterized by a function of the adjoint variable and is obtained by solving a Hamiltonian differentia...